Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: rainydaybloke Date: Aug 17, 2006 8:34pm
Forum: etree Subject: Is it just me?

For the past week or two my download speeds from LMA have been snail-like (about two thirds slower than they have ever been from here).

All these shows have crawled in (server info too if it helps) ...
http://www.archive.org/details/dbatem2004-01-24.flac16
from server http://ia310109.us.

http://www.archive.org/details/hatp2006-08-01.mk4.flac16
from server http://ia301212.us.

http://www.archive.org/details/mek2006-08-02
from server http://ia311511.us.

http://www.archive.org/details/RyanAdams2006-07-22.matrix.flac16
from servers http://ia301242.us. and http://ia301243.us.

In about 3 hours it might get faster if the previous two days are repeated.

I'm wondering if this is due to service activity on the site, or is it high demand placed on specific servers, or some other bottleneck? At times like this would it be better to d/l much older shows which maybe aren't so popular?

Thanks again for all the music.
(and please don't think I'm moaning, I just don't like wasting time and bandwidth)

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffBrad Leblanc Date: Aug 18, 2006 5:05am
Forum: etree Subject: Re: Is it just me?

It could be due to demand on the collection here. Over time, more and more people come here to download from the collection.

I just don't like wasting time and bandwidth

Well, look at it this way. If your LMA download is moving slow, it frees up your bandwidth for other tasks. :)

This post was modified by Brad Leblanc on 2006-08-18 12:05:35

Reply to this post
Reply [edit]

Poster: rainydaybloke Date: Aug 18, 2006 7:56pm
Forum: etree Subject: Re: Is it just me?

Thanks Brad. Unfortunately I don't have any other tasks when I'm asleep or away from the computer all day :)

I thought there were tech-savvy guys you could ask who could point to a reason or two. Demand has always been high - back in the Dead sbd days I bet it was peaking! We have been told there are new servers and of course the revamp of the site which was presumably done to improve many things, not just storage. Surely efficiently coping with the inevitable increase in traffic was also part of the big plan?

A site as large as this must have statistics relating to its servers in both the USA and Europe - slow, fast, overworked, unpopular, down, whatever. I thought some of that information may be shared with the mods at the coalface to help you answer questions such as mine.

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffBrak Date: Aug 19, 2006 10:17am
Forum: etree Subject: Re: Is it just me?

slow, fast, overworked, unpopular, down, whatever?

Yes, yes, yes, yes, yes and maybe. :-)

Thanks for pointing out your experience. A few things have happened over the last couple of months that have impacted the bandwidth.

There are now 3 book scanning centers operational, each of which need to upload at a rate of 100Mbps+. That large amount of incoming traffic has created a bit of contention at the server level. (Several of the servers you mentioned are being used by these book uploads.) The 300Mbps are coming in through our Internet2 connection, but once here, get shuffled around at about that same rate while they are being derived and OCR'ed until they land in their final destination.

Secondly, this datacenter consolidation has meant that the Gigabit fiber connections between the datacenters have gotten a great workout and we've been forced to reduce our aggregate outbound bandwidth to just a trickle above 1Gpbs.

This Tuesday will be our biggest move of racks yet, and by Tuesday night once everything has settled in and gotten plugged in again the traffic will hopefully be flowing better than it has been in a few months.

None of this, of course, has anything to do with the items people are storing becoming more and more popular. I would say that as long as you are able to download a show, the Archive has provided access to an item. Traditional tape trading still has huge bandwidth advantages over the internet, and I would argue that after all of the downloads over the last year there should be a lot more potential traders out there.

Keep in touch with Brad and let's see how things look in the middle of next week.

Reply to this post
Reply [edit]

Poster: xtifr Date: Aug 19, 2006 3:19pm
Forum: etree Subject: Re: Is it just me?

> Traditional tape trading still has huge bandwidth advantages

Yes, but there are some serious latency problems. :)

Reply to this post
Reply [edit]

Poster: direwolf0701 Date: Aug 19, 2006 6:40pm
Forum: etree Subject: Re: Is it just me?

now THAT is an explanation - thank you brak - makes sense now and completely understandable - still the greatest site in the land :)

Reply to this post
Reply [edit]

Poster: rainydaybloke Date: Aug 19, 2006 7:24pm
Forum: etree Subject: Re: Is it just me?

^
Direwolf, thanks for saying it for me.

Thanks Brak for everything you and the crew do. Looking after the entire archive couldn't be easy.
Bring on mid-week!

Meanwhile I will mail out some of the shows from LMA to friends who are ignorant of this goldmine.

Reply to this post
Reply [edit]

Poster: direwolf0701 Date: Aug 19, 2006 8:29pm
Forum: etree Subject: Re: Is it just me?

hey rain - you don't happen to have the 3/23/95 dead show (charlie miller version) do ya? hate 95 but that is a great show regardless - would be willing to trade (even dicks picks if you dont have some). just streamed tha show today and was totally blown away by it.

Reply to this post
Reply [edit]

Poster: rainydaybloke Date: Aug 19, 2006 9:59pm
Forum: etree Subject: Re: Is it just me?

Sorry dire, can't help with that one.
Have you asked at the gd forum here?

Reply to this post
Reply [edit]

Poster: Administrator, Curator, or StaffBrad Leblanc Date: Aug 19, 2006 9:38am
Forum: etree Subject: Re: Is it just me?

Ok, I'll ask around to see if we have any graphs that can be publicly shared. I'm pretty sure there are 2 possible causes to this and it may be a combination of the 2. I might be wrong though,

1. Bandwidth is at 100% useage, therefore everyone gets slower downloads.

2. The server the item resides on has a high load, so it can only feed you a slow amount of data.

One thing to keep in mind. 2 years ago downloads were averaging 12KB/sec during the day (it would take about 24 hours to download a full 3 disc show). Whatever you are getting right now, I'm sure it's much faster than that.

This post was modified by Brad Leblanc on 2006-08-19 16:38:57